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ABS3:EACT; j - . , 

The Early Childhood Education. Progltam (ECE) xs an 
attempt to restr.uctu re public elementary education in C^ifornia^ One 
of the requirements of the pl[>ogram is that it be evaluat^^uring its 
stages of gro^^th ratter than ^upW, cbmpletibn* One* re|>ort must be 
submitted .to the Department of; Education dealing witii the degree and 
success of program /implementatioh, estimate of public progress and 
faudgot. This document was prep^ieired by the Center for the .Study of 
Evaluation (CSE) and is a -summary and critique of the evaluation 
report. The revieir is not an Evaluation of the ECE program, but 
rather it focuses on the content of the evaluation/ 'report or those 
aspects of the rreport that were selected as a comprehensiye 
representation of the Qo;nclus^6ns reached about ECE and the methods 
used to reack them^ (Author/DEP) 
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INTRODUCTION 



'The B^ly Chi1dhood4ducation Program (ECE) is an attempt to compre- 
:hens1)?elyf restructure public elementary education in California^. ECE, esta- ^ 
blished the Legislature in 1972 CChapter 1147, Statutes^pf 1972) , is ^ 
unique fn two importiant ways. First, the program attualizes a^belief in' 
the local controT of education by being based on the development by the^ >' 
local district of a, school-by-school master plan. Jo this end. the Legisla- • 
ture speicified that the govlrning board of the district must. seek direct - . 
communii. parent, and teacher .Involvement in the development of the plan. , 

The. second way ECE is unique is in its insistence upon feyaluation dii^ 
the growth of the program, and not just after its completion or certification. 
Thus .'thk California Legislature requires that each district receiving ECE 
allowances must.submit to the Department of Education at least one report 
'each year^dealing with fiscal expenditures , degree and success of program - 
implementation, and £i.uantitative estimate of pupil progress (Chapter s.!, 
6445.10). Irf addition, the Department of Education must report to the Legis- 
lature the degree of program implementation and the successes of districts 
participating "in the program '(Section 11). 

The inclusion of an evaluation as part of the dynamics 'of an educational 
program is a relatively new phenonmenon. Few precedentCrM'st for conducting 
such evaluations of programs as Urge as ECE. The repoft^ prepared by the 
Department of Education, Early Childhood Education; First Annual Evaluation 
Report. 1973-74 , is a result of that effort. The following revie^, prepared 
by the Center for the Study of Evaluation (CSE), is a summary and cntique 
of the evaluation repoH. 

-In preparing the review, distinctions were made among the program, the 
evaluation conducted by the ECE schools and the Department of Education, and 
the evaluation report. The review is not an evaluation of the ECE Program. 
''4' ^ . yt ' - ^ " 



That evRuation was assigned to the ECi schools and the Departinent of Etiuca- 
tion -by the Legislature, and no attempt has been made t'6 duplicate their , 
ac'hit^vements. Moreover, the review /^pe^'not contain the results of an audit."' 
of the evaluati-on. An audit is usually performed to verify the accuracy- of ; 
an- evaluation, and it: involves .going' to jihe original sources and' reinterpret- 
ing evaluation inloifiatibn. CSE .did^^iiot atloirpt to refer to the original _ 
Department of Education sources. ' Instead, the review fodiJses on the content 
of the evaluation report,, or those aspects of the- evaluation that were se- 
lected and recorded as a comprehensive and accurate representation of the 
conclusions reached about ECE and the methods used" to; reach them. ^ ■ . 

It is generally accepted by practitioners that certain information must 
be included in an evaluation report if it is to, be worthwhile.. For this re- 
view, the informatiofi has beeii grouped . into three categories. These are: 

( 1) The conceptual ization of eVajujition. This category fncludes* fhe de- 
finitions, purposes, and framework, of the eval uati on , , an d a description of the 
audience for whom the report is iTitended. The review will fociJs on the extent 
to whi ch.. this inforgiatioix has 'been:,^presented in the ECE evaluation report^ I 
' (2) A description of the program to be evaluated. The review will dis=-^, 
cuss the clarity with whi ch jthe program has been described, particularly 
those components of it that' constitute tb^ objects ol'' the ECE 'eval uati on re- ' 

port. ■ ? , - . " . ' ■ /: 

—-(3) Descriptions and explanations.^evaluation procedures.- The review 
will focus on the eval uition procedures that were used to obtain inforrnatipn 
about three factors: program Implementation, product evaluation; anrf fiscal 
management. ; - ^ ' ' c 

't • - ' . . - - < 

/ THE CONCEPTUALIZATION OF THE EVALUATION < ^ 

» * * 

' In directing that there be an evaluation of ECE, thelegi stature also 
established guidelines for the evaluation. They were^that t^ Department of^ 
Education should report to the Legislature the deor^of program implementa- 
tion and the successes o^ the districts parti cip^rng in the program.^ In- _ 
eluded in the report was to be a composite spore for each school in the pro- 



/■ 



gram th$t took into account three factors: fiscal expenditures i20% of 
score), degree. and- success cf program implementation {70% of the score)^ and 
a quantitative, estimate of pupil progress (10^ of the score). Finally, the . 
legislature stated" that the Departrant of Education was to compute an ind^x, 
of student attainment, "using factors which have been shown to be predictive 
of school, success" (6445.11). ■ • • • ' . V,* 

In response to the Legislatui^, the ECE evaluation if^port dici ad/lress the 
program's Implementation, pupil progress, and fiscal management. HoweVer, It 
did. not "provide this information for each district and school. Instead, the 
iofdrrnation was summarized for the entire program. 'Student progress : data, for 
exan^jle, were presented by grade level for^ll students in the program or by ' . 
the fMnding sources of programs confined with ECE. Fiscal managemen;t was de-. 
scribe<d according to expenditures by account classification, and pertained to " 
the whole program rather than .to specific schools or districts.. Finally, al- 
though the ^Valuation report states that the Department comp,uted an index of ^ 
student attaijiment for each particular schooT, a description of how this was 
done and the identities of the.schools were not given. T \:\ . * 

The. findings of an evaluation are us.ually summarized and rep:orted by ti sting 
*the coiipelling, or at least convincing, implications of the investigation. Hpw- 
ever, many of the sunwarized conclusions of the ECE report, especially those re- 
garding further needs [e.g., "Districts should be encoura^d to expand health 
^ and auxiliary services" (p. vi) ; "Activities must be. initiated to improve co-, 
ordmatioR with" other state' and ^ocal agencies to impreve the delivery of local 
--heaTth.S(Jrvic6s" (p. vi); and "StandaVdized testing for all ECE participants 
Is necessaiy" (p..vi)] cannot be substantiated by the evidence -that is provided " 
in the report. Thus, they appear to.be, implications based upon unreported 
findings or conclusions 'drawn frem other sources of information or ball e'f. Fur- 
ther, several tables {e*.g., tables 6 and S) seem^to lack any "relevance to; 'the . : 
mandates of the evaluation. (They may provide importaat internal info rroati on 
for- the Department of Education, however.) Finally, the.. ECE report is fragmented 
and unorganized. Page 8, ."Personnel in the Programs defies meaningful organi- - 
zation without the insertion 5.f at least t\io other sections or headings like 
"Nunter of Ful 1 -Time .Equivalent Personnel Employed in Early Childhood Programs" 
and "Required EC^ 'Components." . - ' 
■. Since th^e evaluation report excludes school or district data,- as vjeq'uired 
bV the legislation, it is possible that It was written/for an audience other _ \ 



than, legislators. In .the introduction ,to t\\e report»s.Dr. Riles commends it 
vto "alV Calitpmians," suggestingU lay' audience. If certain, information has 
been excluded for this Audience, but it is available in some other place, this 
sho.uld be made clear in order to facilitate cbmp)ete understan-dl'ng. 

. ' , . • ; . THE DESCRIPTION OF* THE PW36RAM "* . . , / ' 

Early Childhood Education Is conceived of as comprehensive' restructur- 
ing of primary education.. The goverrilng boards of any school d1str>et's that 
have kindergart.en, fir^.t-, or second-grade students can develop submit for , 
approval a master plan for earlj' childhood education. The plan,' developed in . 
cooperation with the coin jnlty.and school personnel must include/a comprehen- 
siv? statement setting forth the district's program on a schQOl-by-school bas|s^ 
The ECE legislation contains standards set by the State Boa/d of Educatiop/for 
review of the mastec plan by the Department. Oistricts^d schools: a re^pecl fit 
cally not -limited to acfiieVence to th°^^ i / ; 

The ECE evaluation report*. h owe velc, neglects tg/provide desg^ptions- or 
explanations of di-strict or school programs. . The ^ader of the/eyaluation re- _ 
port can develop no "feel" for what actually pccurred in the^CE schools.. Far- . 
. ther, no information is given about those schools that staj^d within limits . 
and those that elected to' try o'ut "optional components" like music, art, health, 
and bilingual education, although ,50% of the schools a/e stated to be associated 
wiih suci a component. - ' ' ' , / '[^'^r^-^ 

iAs a result.of the lack of specificity about the •individual programs, a 
. variety of questions about their comparative effi^ctiveness were not addressed 
by the report. Some questions that might ha 'been asked about them are: Did 
some districts or schools have simil'ar"*object1ves for their students by t dif- 
ferent plans for achieving them? To what.extent was each program successful 
for a'll 'participants? / Did some schdols achieve a great deal of success with 
resp^ect to some purposes, but.npj/ with others? Did soms schools have difficulty 
implementing certain components |of the programs, and iJJhy? 

Lack of information about fce individual district and schoo"! leaves the . f 
impression (counter to the legi|tative intentions) that ECE in California is 
relatively static and undimensibnal. Further, in such circumstances, the focus 
of the evaluation was invariably shifted from the unique and dynamic aspects of 



of the programs that are claimed to constitute ECE to those that confomi.6o 
statutory limits. In addition., no dist>inctions are even made among the ways 
in which different programs, while attempts n,g .to adhere to legislative limits, 
interpreted them.- For example, ECE legislation requires t^iat roaster plans ^ 
include "staff development and inserylce trai-oing" (6445.4). A more adequate 
representation of the program would have resulted if „the definition of this 
requirement and a description of 'itJ iinplementation had been presented "in the 
report by district or school'. / ' ' " 

/ REVIEW Olj'' THE EVALUATION PROCEDURES : 

IjL reporting the results of ECE, t^e Department of Education was concerned 

with three maapj?,f^ctofrr:'^rogram'implenentati on ^product evaluation and fis- 
cal managemeftt.^.A'eecause the evaluative proceduip^s associated with the three 
factors were o|iented towards different purposes,- each will be reviewed separately. 

• I ■ ' ' ' ' . 1 - 

Prdqraro Inylen^ntation • . . / ^ - , / . ' : 

As spec/fied by the ECE legislatiolu'program implementation was to con- 
stitute 70%/of,the overall evaluation rating for each school during the fir^t 
yearof EC#s ex1sten^:e. Program implementation data for 1973-74 were obtained 
from a school-level' plan pf^pared according -to_a_speciai _form and a review of > ; 
that plan by at least two numbers of the ECE management team also using a special' 
form. The average of^wo ratings as then converted to a standaK score. - When 
the results differed.more than a set amount, third rating was,' assigned. The 
three ratings ware then averaged and converted to a (undefine^) <?tandard score 
for that school. 

Additional implementation information was obtained through the use of 
Department program a,udit consultants who visiteBTCE school's using special 
audit forms. :^lhile in the school , the consultants observed class acti vities, 
i^nterviewed parents, teadhers, and staff. On the ba'sis of a ten-point scale,/ 
the school was rated according to its implementation of Its ov/n pTan. These 
ratings were converted tc (undefined) standard scores. - • 

„ A third program implementation evaluation procedure was also developed. 
ft.was-inCoyporated in the E- 127-^1 form, which was a report due frojn ea\:h scl?o61 



in Decenter. .1973rApril, 1974i and July. 1974. The reports were assessed and 
the results converted into (undefined) standard scares. . ' . . 

• On the wfible. the ECE report provides -an easy-to-folTow outline of t|ie ■ 
evaluative stepsVaken to ob-tain implementation information. Thus, the quality 
rating of the. school p>an, '5as .-designed by each school j The qual-ity of program \ 
implementation, as determined .by the p;rogram audit; and the results of the 
E-127-I evaluation reports were used to rank schools for eligibi^i'ty or expan^ 
, sion, an|. ultimately provided the tasis for comouting 701of the overall evalu- 
ation of the' school. . " - - . r-' 

. • Vin addition to outliJiing the steps taken to determine the>gree and sue- , . 
cess of program>jmplementation, the eyaluatlon report also .identifies reasons^ ^ 
given for not implementing particular program activities. For example, "ih- . 
. sufficient time allocated in origi-nal planning for completion of activity," ^ , 
was the reason given'.iro^t "frequently. The repoH: also presents data on the 
proposed nufifcer of activities 'fdr a ijrogram component like staff de / 
and the nunter of activities that were and were not implemented:. Furth^ 
■ data are presented .to demonstrate that the schools, that rated Mgh on;;th6 oh-:; ' 

site program audits and on their schoVl-Tevel plans tended to be margtsuccess--^ r 

ful -in implementing their plans". The program implementation section of the - 
.evaluation report concludes with the assertion that nhe data; collected show^^V , 

that a program with well-defined plans and program audits c?p'b&-eyalyated - 
' with greater confidence in the accuracy of the evaluaH^fon p/oduct than a pro- > 

gram vvilh plans th'at are not well -tde fined.'' : - :y-_:\:-^ : / ^ ^ 

Despite the varied and optimistic findingr, and the ■^resentation^^ of an y 

oiitline of the steps that produced many of them,: the ;ECEO^port is lacking the j^^ 
' detail that is necessary to mentally reconstruct the eWluatibn in br(ter to ■ 

more firmly grasp the connections that are said to exist between the x:oricr^^^^ 
' and the procedures u^ed 'tp arrive at them.. For exaniple. Form A-127-S Was us^^^ 

by schools to describe fheir plans. However, no sanple forms are provided to : :: 

graphicaUi' explain .the specific requirements to which the schools were to con- . 

form. Also", no samples of acceptable pl'ans are given as a standard of comparison 

among plans. F^urther, the forms, used byl the ECE Management Team itt reviewing 
'.those, plans 1^ omitted from the ECE report so that the corfespondence hetween 
Uhe reviews and the plans can only be a liopeful assumption. ' - • 



/ Another orntssion frgm th? ECt evaluation report is a detailed d8scrip|:ion 
of the program a'udit - a key conponent of the evaluation - restilting in many' . 
unanswered questions. For instance, what were the qyal i fi cations of the.aadit ' 
consultants, and on whidi-activi'ties di <f cl assroom consultants focus tfieir \ 
attentions? What scale di.d they use in inaking thglr assessn^nts? Were^ ^it 
classes in an ECE school observed or"were only samples observed? If samples \ 
Were observed, how were they selected? Ket:e'.the consultants who observed the \ 
cldssroom the same people wh(^ interviewed parents, teachers, and staffi? Were ; 
.these latter individuals sampled, or was ev(sryone involved* in the program in- 
tervlewed? What did tjte £-127-1 ^report fo|iTi look like'ana -what procedures were 
used to^assess, the school'-s'ivaluation reparts so that the r^ults could be . 
converted to a standard score? ^ z ^ , . ' ' : ."^ 

The^purpose of raising these questions and others .like them is not to 
cast Wi^t on- the, qualifications of the i ndiVi duals jresppnsil)le for the r^.-port, 
or evert the care they took in conpiting. it. , Experienced evaluato4*s hav^^^^ 
rather familiar with the pressures' associated with 'producing a ".timslyan^^^^ 
curate report. Nevertheless, the use of specially-developed and unique evaluation 
procedures for a program'of ECEls magnitjide suggests the need »for a detailed 
.but^concise explanation of wh&t was donel how it was done, and the limitatiops, ,;* 



if any, on interpretations of 
^pcuroentation, the results of 
is what unfortuTLate'ly happens 



the outcomes. In the absence of such care'^ul 
the report tend to lose tl^eir impact. And ^this^ 
in the ECE report. , 



- 1- 



' Product Evaluation ' . , ' - ■' , 

Based -m statuto.ny ' requi rement? , the ECr, evaluati on report descri bes the . 

/degree of effectiveness of each.'of six conponents of the oveirall program. 
TheVe' we re reading/ language, mathematics, health/auxili avy services, pai^nt 
educ2Ci on, parent participation and community involvement, staff development,' 

' apH i nservi ce' educati on . The ECE eval uatijon report also concerns i tsel f wi th 
optional 'program components, like, music and art, included in -50% o;| the ECE 
sVbools. ; Because the'sijc components -f omprise the essential ingredients -of 

' all ECE;programs . i^gardless of other p1anned-for=variatiops ^e evaltuative 
procedures associa|;ed. with each^w.ilT be described. . ' 



' A. ' aeaafng/Lan;.-uage . • - • / . ' ., . i ." 

, " Tha »'6ad1iig/;janguage cXjmponent involved- the testing of "134 ,4 79 students- 
In KijideVgarten, "first,* sec^ond, and third gra#,s (tTie nuf*er, 'supplied In tabler 
■8^'^^npt ma^e^to jib&with tho?e.1n tables 12 w Tables 13, 14,; 15, b.k'oo' ; 
^e^^la'natlonjs pt-ov.ided). 'The detsmf nation pf the veffectl veness .of thi^ coiT. . 
^i&t'was. based on test scores provided by the dlstHcts foV each scboGl and; - ' 
aggnegated by tbe^partrnent pf'^Educatl^ to provi'de infpntiatlon about the over- ' 
all program- .^^./^ • , .f - *. ' ; ' --'Vr i:-. 

lo" obtain this information, students .in ECE.sch<?o1s were first given a^ 
,pretest. Seven rnonths later, they were given a posttest tb ascertain the ex- J ^, 
tent of reading/language iinpro-.vement as a result of beiag In the prog^,ani» TTie 
evaluation report states that in the reading/language deyelopmenC 'eon|3oneiit, :^ 
the ichieveniBnt test scores .showed, an average gain- of 1.1 iron ths c/f growth P^^ 
month of instruction, in grades one through thr6e. In spna^grograjn coirblnatlbns 
e.g., grade two, ECE an.d Miller-Unruh.tnese g.ains i^Wre as^hfgh as 1.4Jinontl]is. ' 
: - Other results presented in the evaluation report include* the, average reading/ 
Janguage development: achjelement by fundi ng_4purces , that )i%;'coiTfa^ [ 
inoney for each grad^; the order of ECE pro9ram\ test' res iK^' a^^ ccw|)ared 
to the 1974 state assessmen| resultsj and the nunfce r and' percentage Iby gracfe 
level r of 'ECE students who s,cored ih eabh qiiarter of the distribution of read- ,, 
iug/languagei development- ach^eMement Jls re^a?ured by the pretest and the jostr 
te^st; »' In .afl cases , ECE stuttents were reported to have perfdnrca we » 1 . . ^ar 
instan^, the report states tf|at the fiunber^pfstudeiits in eacV grade Je in. 
the lowest, quarter of the ''distpbutlon decrebed during the sgven months .between 
the pretest and the posttes't,- while ^fe^-nuiiter in the) fourth^quarter increased. 
• - Th^ results of the overVll^^ ECE pr^grajn, however I n?)resstvely presented, 
must be interpreted a^d accept^ cautiously /Of. coui%e,cautitn .In the Inter- / 
pretatioii'of results is advisabH when 'reviewing, ajyjevaluatfo^ sirice • 

^va>ua£ion techniques* are. continuously evdlvlng and iev^rules^or certainties 
to guide the reader, presently exist,"^ Be&ause^'of thjs,, it is;^Xtrerngly in^or- 
tant'for the writers of evaluation reports^ to 'explain the, l.imit-atlony that are 
-attendaht upon the conclusions so that they are no1:"talcen; out of context and ^ 
misused. s^CCE's evaluation report provides no such waf^ilngs to. be"cStuti§^ with 
the findings, alth'ou'gh sevpral are clearly necessary. - For exanple,, the s*-ii,dent 
progressJ,data are" not presented by school ,or. district and^no cpniia.risionrsniong j' 



' y - ,stu<feiits 'm of femd .^]oJ^t-a '<tet«r«rtn^tion could "be mcfe^ as to whetbe'n soiife ; 

• _ sta(fent5 were .psponMle .for cat ns -onwftethef all ufents rnaW-eqirfv^l^ " 
' . gains* . Having ac^esito such Worimtioft. would help provide tfie makers with 

.. A The ECE eval$|it1on .report- not -only, neglects to p.cevi'de readfrig^Taugtyasa 

' ^ achievement data^y dlstrtci ot's<^m* H also neglects to provide Infomatlon 




q?n|>ar1nS stiide;its attenjingj^ school^ «i'th sttjden|s in ordinai-y schools V|th- ' ) 

in tfhe sarae.d&if^. Although th|"EC| readfh^^ " " '^S 

been exceptt#aU 1% wpuld have -been useful '.to -have been gfvan^addi tipRal as-: ■ 

surance thaf the gaii really were due' to the E|:g progrfro rather 'than > some ;^ 
external A i^nce, 14ke distdct-wjcfe^in^poved Instruction or materf aTis -that i 

favorablf/aff^^ ■ ■: ^.\'''x - \ A '^^'^^ 

Ifefk inyortarit to note th^t the E(E evaluat1on,.f5a^p^^ con-^ 
cept 0f! "gain," whereas only fim-grade st^c^nts Si^r^ {ftS). 
on i^e-posttest. Second Jra^ns co^lte.d,^^^^ 

a Ssiii of a.&^ and thiri" grairs lonpT^^^ the^year^tS a/lco\^ of M. ' p 
r^i«ig at graded l6veAs;.icri&npn Of effecti¥^|Ch and thruse. ^^;g^ 

# gwie eoylvalent scoT^s implies that it is,, thenlcC^nf «ui|%be revi^ 

'■-^jwith'sratie reservations^^^ - ' . - K::^x^=^~'-.i^:-:^X^^^ 

' One last caution should be jie|tion% ;tt Is ci^^toma^in ^s\'aTtfatfpri|i|- * 
perts, to fully describe the measures ehd%Hrunents used* These ^scripwons j . 
. iKually attend to the measures* psychomeifej^ pr^pe^les like relWHiy^ 
lidity, and norm quality, and often ^tall :tW:a>w undef i^htdt iesjt^.^ ' 
we're administered, obsr ^vatlons werf etc^ For Instancy, the spectacular ^ ' , 
monthly gains in reading and language can onl:^ be assessed by noriferefemnced ■ 
tests 4at provide both /all and spring "gr|idg~e5ufva1eni. ncnis — but no test 
nantes afe provided in the report assurance, |fia^^^ torws exist, and that / _ 
the reported findings are not spuripiiB,\ By toln|'to1?ic • 
the re'a&r of the ECE report has b^en seWrely 'lf#|Bd In abftity to fern^ne 
. whether the" gai ns on the achisvenient tests are accuV^^ refTectlons of what 
students really know about reading and langMage. \ .' • 



B, Mathematics 



The. mathematics components ECE is di'^cusstid In a fpkner similar to 
that of the reading/language compojient, and the exact: ssm warnings about ^e 



er|c ' ■ ^ • -si?. 



V ^^-^ 



. reported conclusions apply. '. The ECE evatiatlon t^pbrt states.that acMevemantv' 
test tcoras showed an a^ragelgatn^of i.2irio,nths of grmrth per iranth of in- 
struction In gra^s one throu^ -t^Y^B; The Jmjctgd growth is one inonth of 
"growth per inoflth- of Instruction for the average' student and .7 months for d«s-^^ 

- -Advantaged students - 

In .interpreting the repp.rfs findings , H must be kept in mind^that no . • . 

• ijetween or wi.thin schopi fr diatHctko^^^^ are pr^ientedj many children . 
were not 4nclude/ln the csnptitatiorfs from pretext to posttesf ^ that oftTy the - ^ 
fi.^t gra<fe«^^^c^^^^^ at grade ^leveU and that no.^descriptions 

t/. of/aGhiewnt;te^^^^ ^ - ' - • 

' - -fe v feth/AukilTary Service . ■- " ,-v. 

Th6:hei1th/au?tiUary services v^re^r^^^ 
*■ hea^^exanrinations. |ccQ.rdingito;^he EC&:m^^^ level of. effktiveness ; 
wK deteritrfned primarily by tht^e.evaliiatlon irethodss si^jective staff .ju^fg- - , 
mm eovntin^ of pa*^t|cipants'or activities {425S). and "objective" ipea-;.. ; 

- r^iilWme rating (11^). The report ^tso conclu(tes that It is •'•e>?i<tent ; • ' 
that aSilai^ Wv1ce§ wem effective" in ECE prograijis; It adds that the ei^^ 
fecti^f^s was detemrfned- from the ,t«sult1ng Jn^rovemenfe noted-in puffi.l health, • . 
^amX a&t^*^nd Unproved school attendance. . Howaver.^raj^dures for oh* _ 
taining^lSthetlzint Information about student Ualth.: attitudes- and attendance^ 
€i^her -by ^d'lcE omgrans^ of Education are nftt Ascribed. 

' • ;i f fn|it1y>^^^^^^^^^ reppil^y recontiienda|;1^^^ fr^. the schools' fepbr^ . 

ire v^gsfe and prob^l^ not^spW^^ lo future ECE ^ ; ; 

.progVaii, ' They inclutte injunctions su* as^ "to irrprtve coiHwrni cation" and Hp 
tr^m ^^^^i^y^^^'' The lack, of specificity in ides cn^in^' the type of } 
. heklth -servi cef * examtn^om, etc suggest! that conclusions concen^ing the 
■ ■ program in ihis ama ms%M, accepted with %e. FurtherMt aflso suggests- , 
>\lhatin attenptirig to l^leiifint reconitfen^t4^s; Itke the one to provide ad., 
dfttonal services-, tt^is necessary to fir^st define and e^cplain what services ^ 
.-presently, e^iist.hm^ t^ey v^irk, and un^r kh^ clrcunstances they might con^ 
.• tinue to work* " " . • ' ' - . . %. 



^ ' . •/; 
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y C» Parejit E.dacatioa • ' " • • " "-. . ' / ' 

' .The parent, education componertt required specific objectives and activi-^ . 

ties* that would increase the parents' effect! vene^y encouraging them to be- 
cpme an integral part of the.>orjTial education process. The' Department of Jdur 
caWn, relying. upon an unspecified number of ECE reports, states that parent 
educ^tl'oir>actUiti^s were evaluated by Identffyinq, the criteria for a success- 
ful* pros, 'am and a^essing the. level of specific activities i n neet.ilig' those ■■ 
cnteria. The repprt provides, a Ijst of some of the activities rate4 by scflijol 
persqnnel as riwst important and effective, like instructional classes for parents. 
However, there are 'no school -by-school descriptions or explanations of specific .' 
.parent education prograirs or their e.yaluati*Qns. Thus , the nature and effectlver" 

ness of the pareiit edec^tiOn pre^^ remains 'uneleaf; 

V ' . " ■ - - . 

• »^ * ■ . - 

p.. Barant Participation- and Commu ni ty Involveinent : • 

V' ' ' * The/parent partictpatloji and community i"nvdl>em£;nt component of/ECE 
required ^eci'/ic plans i^or the improvement of contoUni cation bi&t«een the sjfhoqls 
and the conrnuffHy' as^ wetl as parent parti cipati.on in the planning* ini^lemeptation 
modimation, and evaluation of the pi^am andjn the ctas-.^m sducatiop '^r 
the children. According to the ECE report, parent Involvement a ctivi'ttes that 
wev« /tost effective were parent-teacher. coqferences, adviifoYy conwittee meetings.^ 
school-parcnt reelings, use of parent vol if teers and home' communication. How-'; 
ever,, the report aWo concluded that parent e<3ueati on and involvement activities 
we^^.somstines' coimii'ngled in practice, which fliay acpount for^^some of the pro- v - 
biems ,|ha-t existed In interpreting the results 'of the parent educatipn coriponentj 
The- events leading to. the conclusion were not described* nor was t^fe extent to. 
which' the coijiningTing took place discassed. _^Q,not dealt^W^^ 
ofvrelkionsblp betvveen parent educaiion an/ Involvement activities and the 
specific successes of ECE school proc^^am^^ , , . \- ' 

E. Staff . Devel o p'ment- Inservf ce Educati on ^ . 

The?5taff devel opipent and ins'grvice education component relied priinarilS' 
on sti)jectiye judpisnts {6X of the methods used). Comparisons were also tnad^ " 



between the importance jind the effectiveness of staff development activities. 
The nature -of the judg,ments and the procedures' for the conparisons are not de- 
scribed. Further, as the ECE.evaluation report state?, this compipnent was 
rarely evaluated in. terms^ of the implementation of inservice training into the ^ 
classroom. Further, even for cases where implementation records were kept, no ' 
information was provided In the report, s^out the 'Relationship between inservice 
education and iirproved student 'performance. 

F. Fiscal' Management " . . - ^ ' • ^ , 

The* report of .the ,fi seal -management component also is summarizeci over 
all schools and districts, contrary to legislative mandate. The surnnary \n- ' • 
directly indicates overall compliance with 'the legislative intent for expendi- 
-,tures; but in an all -too-common disregard for compelling logic, the* recommenda- 
tions bear little connection to the reported findings. 

' - •' ' ' " r* * " ' . ; • 

V CONCLUSION * . - 

The Early Childhood Education;. First Annual Evaluation Report, 197-3^74" 
has left many .questions unanswered. Soms of them, especially those concerned ' 
with describing and comparing the inplemeritation and outcomes of. each EpE sdiool - 
prograrn must be answered if .accurate and valid, interpretations ofjlie efTectilve-. 
ness of the entire ECE program Cre to be maje^^— — - — -"""^ . , ; . 

To soWjextent2jioweyerj,2the fact that many questions remain unanswered 
should be regarded by the evaluator as a likeTy effect of participating in^ the ; 
development of any new program and sharing its growing pains. Nevertheless, V ; " 
there is a. definite need for a "master evaluation plan," analogous in. spirit 
to the required master plan for each ECE school-. J.his plan should be responsive 
to the^ purposes oi" specific programs, but. must be primarily oriented toward ^ 
the concept of early childhood education as an overall restructuring of Calif orni|' 
schooling. To achieve this, the master evaluation plan would contain detailed • 
gui(tel1nes for the selection, collection, analysis'and reporting of informatioji 
about the individual and conparative accomplishments of all ECE schools. 



